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^ -_The purpose bf this mcnbgraph is tb review _and 

syhthesize the_ literature pertaining directly tb the use; of clbze: as 
a teaching technigue. The literature review is arranged into eight 
sections: |[1V analysis bf comparative st udies , ' in which stud ies that 
have compared the cloze procedure are examined: (2) analysis of 

which the effectiveness of clbze for 
purposes is reviewed: ( 3o) -anal ysi:^ of 
u^e of cloze with various types of 'r-eading 
materials -and-the-transfer effects-^of-^cl {^):_ ■ 

analysis of ^age, -grad^.^ le vel^ and. readina ability; <5j .analysis of^ - 
teac&ihg_pr6cedur^s^_\in which discussion^ aroupihgr sequencing, and 
Jenqth of in'^trnict ion a ire examined : / 61 __a na lysis^f . de ietion'. . _ 
strateaies: _ (7) analysis of scorina m ethbds ; and (3) analysis of 
students attitudes^ Following the inSividuai analyses^ ' the 
conclusions bf the complete review are summarized^ The : monograph also 
cbrt^tihs a discussion of future* directions for Research and 
instructicn involvina cloze. Each study reviewed in the; monograph is 
summarized in ah appendix. (Ft) 
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When Wilsori^-Tayl or introduced cloze tests, researchers were 
quick to see their useful hpss^for rneasuring the difficulty of 
materials. But few of u^ thought they wbuld make good 
teaching exercises. We mou^ht that the items were too 
complicaled psychblbgicaHy. Many different cues have to be 
used to answer an iteixl. Each cue makes use of a different kind 
of skill. And it seemed hard to find even two items that would 
provide practice on the isame skill. So cloze exercises would not 
provi(|e the kind of systematic practice that we thought was 
needed.^ _ ^ 

^ FortunatelyvH few people Jisagreed with us and set out 
to prove us wrong. As Jongsma reported in his ^earlier 
monograph, initial resultsr were not very promising. But the 
researchers pressed ahead and: others joined them. Now, a _ 
short time later^^ their results have been so abundant and ^ 
productive that Jongsma has been asked to write this second 
review. 4 ' 

There is in^ch to praise about the present review, but 
three features se^rri especially valuable. The first is the clarity 
and brevity with which Jbrigsma summarizes this widely 
scatter^- body of research. Hiis eariier review did the same 
thing and help^ to touch off maay of the studies he reviews 
now. Thia present version jio-doubt will be even more seminal. 

Second, teachers and researchers should carefuUy^tudy 
how Jongsma organized this review, for that organization 



J 

e 



carrieH a very i rii p6 rt ah t message. Jdrigsrha believes that cloze 
exercises are not^by therhselyes, a complete instriictibhal 
treatrheht. Varitffiohs in the students we teach and differences * 
in how we rriake, present, and score, cloze exercises result in 
important distinctions in the kind arid amburit of skills 
students learn. The problem, as Jdngsma sees it, is to find but 
which , variations serve which purposes best for which, 
students. - _ 

• - The third feature is the provocative,way Jonpsma putfi 
his conciusions. Some might think he shoaid have qualified 
them heavily. But that would have hidde-n the gaps in our 
knowledge of cloze ex^ercises. .Instead, he states them boldly, 
hurlirig'therh as challenges to the teachers arid researchers 
who will do the next wave of studies. Judging Trbrii those 
reviewed here, thai wave shbuld be very interesting indeed. 

^) ' ' ------ ^ ; - 

i Jbhh R. Bbrrhuth 

University of Chicago 
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The Educational Resources Iriformatibh Center -{ERIC) is a 
hatibhal ihfdrmatibh system developed by the United Statois 
Office, of Education and now sponsored by the National 
Institute of Education (NIE). It provides ready access to 
descriptions of exemplary progra^ris, research and develop^ 
ment efforts, and related information useful in developing 
more effective educational programs. ^ _ 

Through its network of specialized centers or clearing- 
houses, each of which is responsible foj* a particular educa- 
tional area, ERIG .acquires, evaluates^ abstracts, and indexes 
current significant informatibri arid lists this iriformatibri in 
its reference publications. 

ERIC/RCSi the ERIC Clearirighbuse oi^ Reading arid 
Commuriicatibri Skills, disseminates educational iriformatibri 
related tb research, iristructibri, aiid persoririel preparatiqn at 
all levels arid iri all iriistitutioris. The scope of intere^it^ the 
Clearirighause includes relevant jresearch reports, litera 
reviews,- curriculum guides and descriptions',' conference 
papers, project or program reviews, and other print materials 
related to all aspects of reading, English, educational jour- 
nalism; andispeech coriimunication. 

iiiTKe ERIC syatjtem has already made available— through 
the ERIC Document Reprpductibri Systeibi— rriuchiriforrhative 
data. Hbwever, if the firidirigs bf specific educatibrial research 
arfe tb be intelligible tb teachers arid applicable to teachirig, 
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c()nsi(i(Tal)I(v IxnlicH ol' data iiuijit b(» roevaluatt'd, fnriisrtl, 
tran.^latcd, aiul nioJdcd into an i^HKCwituiLly (jifiVrcviit; rontoxt. 
HathtT than nvstin^' at ihv point of making rosoar( h\n«p(irLs 
readily acccssiblo,: NIE Has directed i\\c HV\mriiiv clearinK- 
hoiises tj) worjt with proFt'ssional organizations in dovoloping 
ihrorhiation aiialysi.4 papxTs in spcrifK- areas within the scope 
of the cit'aringhoiises. 

Vlozr lustriictum Rvscarch: A Srroruf' J/ook is a 
,c-oinpani()n volUriKv of The jClo^r Pror<Y//7rr' /In 1^7Wz(7n7/^' 
T^^^^^^^'^f^^'i':'^^^'^^ by Kugeiu'rJ()iigsma and pul)Iisli(»d in 1971 by 
HRIC/(^RIHR and the Interhatiohal Reading Assoc iatiori, 
KRIC/RCS is plea.siul to roopivrati' with the InU^rnatiohal 
Reading Association in making this hook availnble. 



Herriard O'Dohriell 
Director, KRIC/RCS 
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When The Cloze Procedure As A Teaching Technique 
^Jongsma, 1571) was .written, the clozeiprocedure had already 
become a widely used research tool. However, cloze was j.U8t 
begihhihg to make its way into the classroom as a device for 
teachers to use. Unlike the vast body'bf research on cloze as a 
readability arid assessment technique, the literature oh clbze 
as an instructidrial technique was sparse. Only nine studies, 
nearly all the existing research up to that point, were reviewed 
in that volume. One of the major conclu&iohs reached in that 
review was the research evidence, at the present time, does 
not suggest that the cloze procedure is an effective teaching 

technique" (p.l8). _ 

In the past ten years, a plethora of prticies have ap- 
peared extolling the instructional virtues of cloze. This seems 
to raise a curio usT)ar ad bx. EJither practitibriers aren't heeding 
the advice of researchers br researchers aren't discbyeririg 
what practitibhers know tb be true. In any event, much has 
happened ih the past ten years and perhaps it's appropriate tb 
take a fresh look at the issue. 

^^ii^^^^'^j^^^^^^^^^^^n Series ;^ We Go? was 

origmaliy-concelved-by-ERI^ stimulus 
for research, ^med at college -profeBBors and graduate 
students, the series .sought to review selected topics, with the 
hope of extending and strengthening research on those topics. 
Apparently, the series has succeeded. In this volume, thirty-six 




studies Haye hvvn roviowod, roritnisteU w iiiiio studies 
iiieluded in t}u^l971 revic'w/rweiHV-six ()rih(Hhiriy 
are (loiloral disMertaticHis. 

The purpose of this m()h|^)graph is similar to that of the 
ejiriier voiume: that iKt() critically review aiid synthesize th(^ 
litoratare pertaininR directly to the une of cloze as a teacliiilK 
technique: In addition, weaknes.si'H in the existin^^ literature 
will be identified and sURReHtionH will be matle regardin^j 
future research. 

Perhaps a few wofds should be mentioned abi)at the 
literature seiirch that wijs conducted in preparation for this 
monograph. The literature search was basically limited to the 
past ten years, 1970 the peri()d .since the 1 97 1 reyievM.One 

study conducted prior to 1970 has been included simply 
because it was omitted ffbm the previous review. None of the 
gtudies included in the earlier volume has been re-reviewed. In 
^^^^M^y?^^ the existing research, searches were 
made of the following data baaes; 

' Current In dcjc to Journais in Ediicatmn 
, Dissertation Abi^travts intvrnationui 
/ Resoiirces in EduQatian X, 
Psychological Abstracts 

Uahuua^e and Language Bvii a vior A bstracts 
Because emphasis in this review is on: the kinds of 
questions that have been asked and the geh:eral findings, the 
review was limited to published sources, including Disser' 
tation Ab^tracts^ Inter national, and did riot attempt to gather 
the original unpubHshed dissertations. 

All of the studies which had used the cloze procedure 
were screened Needless to say, a vast amount of research has 
been conduct^ either using cloze a tool to examine 
language vari4ibles or investigating characteristics of the cloze 
procedure itself. Only those studies which dealt directly with 
the instructional use^ of cloze were selected and reviewed for 
this monograph. ^ 
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Review of the tjiteratiire 



The iricreased growth of research on cloze as a teaching 
technique precludes individual critiques of each study in this 
yblume. Therefore, an effort has been rnade to analyze th^ 
literature by selective dirriehsiohs. It is hoped that this 
approach will lead to a state-bPthe-art^ summary that is 
meaningful arid useful. All of the studies reviewed for this 
mbridgtaph have been summaHzed in the Appendix. 

The review of the literature has been organized into eight 
sections. Each section is briefly described below4 ,^ 

1: Analysis of CainpnraXive Studie^\ ^ 

studies which have compared the cioze procedSre with 

other methods of ihstructfZh. 

2. Analysis of Ihstructiohdl Goals. Reviews the effec- 
tiveness o*f cloze for different iristructibrial purposes. 

3. A hatysis of Materials , Discusses the use of cloze with 
various types of reading riiaterials arid the trarisfer 
effects of cloze iristrtictibri. 

4. Anaiysis of Age, Grade Level, arid Reading Ability. 
Explores the effectiveness of cloze instruction for 

^ different age, ^ad^, or reading levels. - 

5. Anaiysis of Teaching Procedures: ExBinines discus- 
sion, grouping, sequencing, and length of ihstruction. 

6. Anarysis of Deletion Strategies. Reviews the effects of 
different deletion systems and modified cloze formats. 

7. Analysis of Scoring MeiKods. Cbrhpares the instruc- 
tional value of differerit scbririg systeriis. 



8:]Ajmiysis of Student Attitudes, Examines student 
A ^^ttitudes toward cloze instrtictidri. 
r immediately following the eight individual analyses, 
the conclusicijis of the complete review will ie summarized. 

Analysis of Comparative Studies 

Is the cloze procedure an effective teaching technique? 
Most investigators have sought to answer tha^ question 
through a cbmparative, rather than an. absolute approach; 
That is] cloze has been corhpared to other rhethods of teaching 
reading as well as other rriethbds of teaching content subjects. 
Twenty-seven of the thirty-six studies have used this approach. 
" ::i Q!^?? been compared to a wide variety of instruc- 
tional methods: conventional compreherisidri exercises (Cox, 
1974; Culhane, 1972; Ellington, 1972; Houston, 1976; Johns, 
1977; Kazmierski^ 1973; Martinez, 1578; Pepin, 1973; Pessah, 
1975; Rhodes^ 1972,.Rynders, 197ir^dSteWari^l9^ 
" discussion: (iMcNamara, 1977; Phillips, 1973; and Pawer, 1976); 
S_Q3R (MGNamara, 1977i; daily silent reading (FaubiQn^l971); 
selfselected re^ading and phonic'exercises (Paradis & Bayne; 
1975); dramatization (Blackwell, e± al., 1972); reading centers 
(Sampson, 1979); oraL language drills (Whitmer^ 1975);: oral 
reading (Kennedy, 1972); regular algebra instruction (Bvirn- 
ham, 1973); regular geometry ihstmctidn (King, 1974); regular 
spelling instruction (Glaritdn,a977); regula sdcial studies : 
instruction (Grant, 1976); and converitidrial fdreigh language 
instruction-(GreenBwald, 1974). v 
* to employ; aii 

experimentaf design in which some ofih^siudents receive one 
ojT more forms of cloze inatmctfon (experimental group^ whi^ 
the remaining sft^nts receive: the ''regular" or "traditional^ 
rnethod of instruction or some alternative method contrived for 
the study (control group)." _ • : 

These comparative studies, which are commor^ 
edUcatidrial ^esearch^ have certain: inherent weaknesses. 
Seldom is cldife the sdle treatment received by the experimental 
group. Cloze iristnictidri is usually just one of marS^^ efforts 
diluted at imprdvirig reading ability during the typicJl school 
day. These studies are alsd especially vUlrierabM^tb the 
Hawthorne effect which accompanies novel mettfes of 
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instruction. Inability to control jextrarieous variables in. such 
studies also threatens internal v^^^ • 

Given the jimitatipns of these studies, the literature 
strongly indicates that cloze is rid better or no worse than 
conventional methods of reading instnictidri. Seventeen of the 
l^enty-seven cornparative studies (63 percent) found no signify 
icant differences be^^n cloze and other instnictional methods. 
Three st^udiea (Burnham, 4^73; Grant, 1976; and Sampson, 
1979),^ or 11 percent foiind some differences favoring cloze. 
Strong differences in support of cloze^ were found- in seven 
8tudie8:(Bemath, 1977; Blackweil, et ah, 1972; Culhane, 1972; 
Kennedy,. 1972; Martinez, 1978^ Pessaha, 1975; and Whitmer, 
1975), or 26 percent of the total. 

These results closely parallel those of earlier cioze 

. instruction research. In the previous review: (Jongsma^ 1971), 
six of the nine studies were comparative studies. Four of the six 
studies (67 percent) found no significant differences between 

. cloze and other methods of instnictidh; dne (17 percent) fourld 
soiM4iifferences favoring- doze; and dne (17 percent) found 
strong differences in support ,of cloze. 

z: * Lii^^j^^y wonder why differenceis were found in a 
few stddieaint not in the overwhelming raBjority . One possible 
explanation may lie with the control ireatraentsi;hat cloze was 
compared to. Whitmer (1975), for example, compared the use of 
written cloze:exercises in French with oral driiis and causeries 
(informal: cKats) and then evaluated: progress on a stan- 
dardized French reading; test.:Blackwell (1972) compared the 
use df cldze exercises with dramatizatidh and assessed gaiiis 
dn a standardized reading test. K^hedy <1972} compared 
auditory arid visual cldze training with dral' reading and no 
training and then assessed the effects dn cldze tests and a 
standardized listening-reading test. It would seem thatiri each 

9^:^'^??^^^^^^?? ^^^^?^ ^'^^^^^ were not focused 

spedfically ort improviri^reading^ Yet their effectiveness was 
judged on the basis of reading: tests. The dependent or criterion 
measures were simply more closely aligned with cloze 
ihstructibn than they were with the other methods used: 

Comparative studies don't fully answer the question of 
effectiveness, Statistical testing in such studies i^ usually 
directed at^etermining if there is a significant difference 
between treatments. The finding df nd significant differences 



Review df Literature 



14 



5 



may mean the treatmentis are equally effective or equally 
ineffective. As- n^entioned earlier, seventeen studies reported 
no .significant differences between cloze and the- other 
instructional methods: An effort was made toiook beyond their 
non-significant differences to determine whether the use of 
cloze resulted in absolute or real progress. That is, didihe cloze 
instructional groups make progress from pre- to po^-assess- 
rheh^, despite their lack of superiority over their control 
counterparts? Five of^ the investigators (Claritbh, 1977; 
McNamara, 1977; Rynders, 1971; Stewart, 1967; arid Greerie- 
' wald, 1974) report significant gains in achievement, even 
though there were no differences among treatments. Rynders, 
for example, found that the sixth graders in his study made 
mean gains of sixjnonths in comprehension, after five weeks of 
instruction, using either cloze or more conventional compre- 
hension exercises: Seven of the studies (Cox, 1S74; Ellington, 
1972; King, 1974; P^radis & Bayne, 1975; Phillips, I9f 3; Power, 
19:76; and Johns, l:977):do not mention absolute^ain^, making 
it impossible to judge the effectiveness of cloze. The remaining 
five studies (Faubion,; 1971j_Houston, 1976; Kazmierski, 1973; 
Pepin, 1973; and Rhodes, 1972) found cloze iristructibri, as well 
as the comparative treatment, to be ineffective. 

To summarize the analysis of comparative studies, then, 
it appears that the cloze procedure can be an effective 
iristructibrial technique. However, cloze is no more or less 
effective than many of the conventional instructional methods 
that are widely used. 



Analysis of Instructional Goals 

The cloze procedure has been Used for a variety of 
purposes: to improve general reading achievement, to increase 
reading or listening comprehension, to develop reading 
vocabulary, to increase reading speed,^.to improve &peUing,-to 
increase knowledge of content subjects, and to improve the 
ability to read content area material. One may analyze the 
literature by looking at differential effects for various 
instructional purposes. Is the cloze procedure more effective for 
certain instructional goals— for instance, comprehension or 
vocabulary — than it is for others?. 
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Three concliiSLons seem to emerge when the literature is 
ahalyzS in this fashion. First, the cloze procedure has been 
most effective in developing cbmprehehsibh. A large majority 
of the investigators have used cloze for this purpose. 
Regardless of whether progress is assessed with standardized 
achievement tests or wth project-developed cloze tests, cloze 
instruction is as equally effective as cbriventibhal methods of 
comprehension instruction. Second, cloze does not seem to be 
effective in improving reading vocabulary. However, this may 
be a function of the way progress^as been evaluated^ Nearly 
eveiy investigator haa used a standardized- vx)cabuiary 
which words are presented in isolation, it s not surprising that 
short-term cloze instruction has little impact on such mea- 
sures. Third, cloze instruction does appear useful in helpjpg 
students learn to read and understand content material. The 
strongest evidence has been reported in social studies:(Grant, 
1976; Paige, 1976; Martinez, 1978; and McNamara, 1977) but 
there is also some support in math (Burhham, 1973).^ 



Analysis of Materials , 

One way of analyzing the Hterature is to look at the types 
of reading materials that:were used. Is cloze instruction more 
effective with cert^ri types of material than with oth^fB? A 
common dichbtdrhy that is often made in th^ literature is t^ie^ 
distihctioh between narrative^ or story-like materials, and 
expository, or cbriteht-based materials. Some studies employed 
narrative passages, others were restricted to exposition, arid 
some used a combination of both. No study wa& found that 
specifically investigated the differential- effects - of -cloze 
instnictiqn OKLtype ofjnateriaL Since-both significaiitand non- 
significant results were found for both narrative and exposi- 
toiry materials, we have to conclude that cloze instructidn is no 
more effective for any particular type: of material. A definite 
trend was observed in that more and more researchers are 
using cloze tQ teach subject matter content or reading iri the 
content area^. \ ' . ' ? 

^Another aspect of materials analysis is the question. of 
transfer effects. Does training in specific coriterit materials 
improve general reading ability? Does training in general 
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reading materials transfer to the reading of content materials? . 
Several studies have explored this iss^ 

Three studies examined transfer effects within . the. area 
of social studies. Grant tl976) provided all cloze instruction^^ 
with sodal studies materials. After nine weeks of instruction, 
s^B found that students scored significantly higher on a test of " 
social Btudies content but did not improve on the Gates- 
MacGinitie i^^^din^ TjeBi/ n tes general reading ability. 
Martinez (1978) trained students in narra^ve materials then 
assessed progress on a social studies cloze test and a social 
studies content te^t. Significant improvement was observed on . 
both tests. Lik^ Grant, Guscott_(ig7Ji offered inatructio^n only 
in social studies materials. He found significant improvement 
on the reading portion of th^ Iowa Test of Basic SkiUshutnot 
on a social studies cloze test. Guscott's findings, however, must 
be viewed with some skepticism since he used a posttest-brily 
design and had no assurances that the groups were evenly 
matched. 

_ Two studies explored transfer effects in foreign lan- 
guage instruction. Binkley41^75) found that cloze* training 
with German passages did improve reading ability in German 
but did not significantly increase performance oniheiVe/;^n- 
Denny. Greenewald (1974) found no significant difference on a 
French cloze test between students who received instruction on 



French cloze passages and those who received training on 
English cloz^ passages. 

Burhham (1973) used algebra materials for all cloze 
instruction. Pbsttestirig revealed^^ighificaht irhprovemerit in 
the ability to read math materials but rib cbrilparable 
improvement in the ability to read "ordinary English," 
LLkewise,-Phillips^lS73) found thatins in introductory 

business materials did ncjt^transfer to the A^<?/son-Z?mny. 

A slightly different form of transfer was examined by 
Kenne<iy (1972). Qne experimental group received"- auditory 
cloze training while another received visual cloze training: The 
effects for both groups were assessed on listening tests and 
reading tests. Visual cloze training was found to be the most 
gerieralizable. 

Wheri these studies are viewed collectively, some 
tentative patterris-seem tb errierge. It appears that training in 
general cloze itiaterials does transfer tb thereadirig of specific 
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cbriteht matenalfi._Qi_tfie__oiiier hand, cloze instruction in 
specific content materials may result in impr^ to 
read similar materials hut is-imlikeiy to raise general reading 
ability:. This conclusion is somewhat speculative and should be^ 
viewed cautiously. Perhaps transfer effects are an issue worth 
exploring in future research. 

^ One final aspect of iristructiprial materials should be 
mentioned and that is difficulty. There are indications that 
many researchers may have vused materials that were too 
^^^''^ ^^jj^^i^i ^^^udents. Perhaps a few examples will 
illusteate thia point. Jn constructing her cloze posttest, 
Martmez (1978) selected^ a jiassage from a sixth-grade social 
studies textboolc which the^tudents had not been exposed to. A 
subsequent readability check revealed that the passage was 
Written at a tenthrgrade level of difficulty . Yet, the passage was 
still used. In the Grant (1976) study , students who hadreceived 
cloze instructibri for nine weeks: still scored, on the average; 
below 30 percent correct on the cLoze posttest, clearly a sign of 
frustratiGn. Although Rhodes (1972) prepared passages at each 
level of the Dale-Chall scale, he prepared twice as many at the 
highest level, college difflculty, suppbsedly to prevent, ceiling 
likely that most of these passages were much 
too difficuit for his sixth graders. 

^ It'simpossiblejto assess what effect excessive difflculty 
may have had on the studies reviewed in this monograph. 
Anyone who has ever worked a cloze exercise- knows it's^a 
difficult task. The practice of judging studentsV raading 
abilities on the basis of scores on a standardized te^t and then 
assigning cloze exercises of the same level should be viewed 
with skepticism. Future researchers, as well as practitibrierSi 
ne^ to be more cautibus in matching clbze ihstructibhal 
materials with their students* abilities. 



Analysis of Age, Grade Level, and Reading Ability 

z I - ^^^^^y^^?? the Jiterature is to lbi>k at 

differences among age or^^ade^ levels. instruction 
better suited for a particular age group? The researchhas been 
fairly evenly distributed acrosstgrade levels: Approximately 17 
percent of the studies have been conducted with primary 
children, 36 percent with intermediate grade students, 19 
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percent with junibr'senior High schoolers, and 28 percent with 
collegestudents. 

When the results of the studies are analyzed by the grade 
ranges mentioned above, rib clear pattern emerges. Cloze 
ihstructibri has been strdrigly successful, niod^r^tely^occess- 
ful, arid Urisuccessful at all grade rariges: There is no evidence 
to support the use of cloze instruction at one particular grade 
range^ as opposed to another^ 0ne point is worth noting here, 
however. It ia often recommended that the use of cloze be 
resteicted to fourth grade and above. There is sufficient 
evidence to suggest that cloze instruction can be just as 
effective with primary grade children, provided it is used in a 
form similar to that employed by Guriri arid Elkiris (1976), 
Kennedy (1972), Sampson (1979), or Paradis arid Bayrie(1975). 

The effectiveness of cloze iristructidri may also be 
Analyzed by the persbrial characteristics of the learners; Is 
cloze iristructidri riiore effective with particular types of 
readers, say high ability or low ability students? Six studies 
^ have utilized levels by treatment designs to examine this 
question (Cox, 1974;eulhane, £972; Guscott, 1971; Kazmierski, 
1973; Rhodea, 1972; and Yellin, 1978). In each atudy, except 
Culhane, which will be discussed later, the researcher 
atratifieci the sample on the basis of reading ability which w^s 
: uaually determined by scores on a standardized test. This 
stratification usually resulted in three groups— above average, 
average, and below average readers. This type of design allows 
for the testing of aptitUde-treatriierit iriteractions. That is, the 
investigator cari explore whether a certain type of treatment is 
more or less effective with particular types of-students - 

Iri every case, there was no significant interaction 
betweeri reading ability-and the type of cloze instruction. The 
one exception is Culhane. He Ktratified hisisample on the basis 
of -IQ scores, rather than reading ability. He then looked at the 
interaction between intelligence and method of scoring cloze 
teaching exercises («xact replacements versus syridriyriis). A 
significant interaction was found, iridicating that syridriyrii 
scoring was nibre effective with low IQ studerits. Sirice 
Culharie's is the drily iristarice df ttfis interaction, it should 
probably be viewed as teritative until confirmed in future 
replicatibris. Overall, '^he research consistently indicates that 
cldze iristructidri is no more/no less effective for particular 
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levels of reading ability nor are certain types of cloze formats 
better suited for particular learners. . 



Analysis of Teaching Procedures 

- _ _ Cloze ^an be presented to studenta in so many different 
ways that it is difficult to judge its effectiveness without 
considering the particular ways in which cloze was presented 
and used. This 'section will examine the specific presentation 
features: of discussion, grouping, sequencing, and length of 
instructibh. 

Discussioh.. One of the criticisms made of early cloze 
ihstrUctidh research was the lack of real teaching. Many 
investigators relied dri cloze to do all the work. It was believed 
that simply having students complete a specified number of 
cloSse exercises would result in improved readmg ability. In the 
first monograph <Jongsma, 19^ it was suggested that future 
studies- might explore the effects of discussion on cloze 
instruction. __ : 

JFour studies specifically assessed the effects of discus- 
sion.: Cox (1974) cbiTipared three ihstructibhal treatments on 
disadvantages fourth graders. In the first cohditibh, the 
teacher gave ten minutes of irlBtrUctibn on the use of context 
clues after which students silently and independently com- 
pleted a cloze exercise and then checked their responses. The 
second treatmentconsistedof studente* firstcompletinga cloze 
exercise independ^tly aniithen participating in teacher-led 
class-discussion of- the responses and clues. Discussion was 
followed by a new cloze exercise for reinforcement. The. third 
group read the same passages intact and answered multiple- 
choice :questions. Class discussioh ,bf their answers and 
selected oral rereadirig for verificatiph follbwed. Cbx found no 
significant differences am^ 

-Yellin n97]8) compared a "product approach" arid a 
"process approach" to cloze instruction. The product approach 
was essentially a self-instructional method. Students jcqm-- 
pleted cloze exercises silently Jind independently^ then^scored 
their responses against the^act replacements pro vided by the 
teacher. In - the process approach, students worked cloze 
exercises cooperatively in small discussion groups while the 
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teacher served as a facilitator. No significant differences were 
found jbetween the two groups; 

Faubion (1971) also examined the effects of discussion 
with fourth gracl^rsr One experimental cloze group simply 
completed a cloze exercise, silently and independently, each 
day arid then was given the previous day's exercise in corrected 
form. The secbrid expeririierital group followed a similar 
P^^^^^ji^^^^pt tt^^y discussed the previous day's exercise, 
verbalizirg^he appropriat^riess oi their choices. A third group 
read the same passages silently in ari iritact form. There were 
no significant differences among the three treatriierits. 

Pessah (1975) laoked at the effects of iritegratmg cloze 
instruction into a remedial rBading-program at the college 
level. A control group which received the "regular" remedial 
instruction was compared to three expenmental cloze groups. 
Two of the cloze groups used discussion while the third was 
completely iridividualized. Although the experimental groups 
butperfbrmed the control groups, there were no significant 
differerices ariibrig the three experimental groupg. 

Contrary tb Ibgical exp>ectatioris, studies that have 
specifically tested the effects bf discussion hav^ consistently 
found that cloze instructibri with discussion is rib more 
^^^^^^^i^?°i^^_d^P^^dent cbmpletibn bf cloze exercises. Does 
this mean that discussing cloze exerciseis is uriprbductive arid a 
waste of time? Not necessarily. First, some investigators have 
found cloze instruction with discussion to be successful. For 
example. Grant (1976), &unn and Elkins (1976), Martinez 
(1978), Kyjiders (1971), Sampson (1979),. Sinatra (19-77), and 
Smith (1970) all made discussion an integral part of instr jtction 
arid found it effective, even though discussion wasn't an 
isblated factor that was tested. However^ including discussion 
. doesn't guararitee success as Johns' study H[1977) illus- 
trates. Second, discussibri as a research variable is rather 
nebulous. Effective discuissibri depends upon riiariy conditions 
such as the teacher's ability to recbgriize syritactic arid 
semantic clues to cloze replacements, the ability tb cbriiriiu- 
nicate those clues to students^ studentsV abilities to perceive 
and internalize those clues, and probably a host of other 
conditions. It's impossible to judge the qualitylof ^discussion 
from written research reports. Although the studies that have 
specifically tested for the effects of discussion don't confirm 
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ite effectiveness — #hen all thte research is taken into consider- 
ation— *the literature seems to suggest that cloze instruction is 
Hkely to be more effective with discussion than without it' 

: Qne other aspect of discussion is worth hotihg arid that 
is who leads the discussiori. Iri some studies, the teache^^ * 
control of the discussibri with iriteritibris to _*-t^ach" predeter-' 
mined concepts. In other -studies, the teaCher served as a 
facilitator to small student discussion gn'bitps and teaching 
seemed to be incidental. In still other studies, the students were 
solely responsible for the discussion process. Does the method 
used make any difference*? Only one study looked at this 
particular aspect of instniction: Culhane (19^72) found teacher- 
led -discussion following cloze exercises to be significantly 
more effective than student-led discussLon: 

Grouping. Another issue that is closely related, to 
discussion is that of grouping. Do certain grouping patterns 
^ facilitate the use of cloze? Only one study could be found that 
specifically exariiiried this questibri. Ryriders (1971) cbriipared 
the use of cloze exercises with the use bf intact passages 
accbmpariied by interpretive cbmpreherisibri questibri 
eacb treatriierit, studerits were assigried tb either hbmbgeriebus 
br heterogeneous discussibri groups. In bthef words, type bf 
grouping was built into the study as a testable factor. Rynders 
found no significant differences between these two types of 
grouping patterns. „^ _ _ _^ _ 

Soma studies have used cloze instruction in a completely 

individualized matinen Others have relied heavily on small 
discussion groups of three to five students each. Still others 
have used whole class: instruction, even to the point where 
students didn't have individual copies of the cloze exercises but 
^ worked: them collectively via** ari bverhead prbjectbr. At this 
pbirit, there is rib eriipirical evidericeAtp suggest that orie type bf 
grbupirig arrarigeriierit is riibre effective thari aribther for clbze 
iristructibri. . 
- Sequencing. Wheriever various levels or types of cloze 

materials are used for instruction, sequencing becomes an 
issue. Are^ some sequencixig patterns mor^ eff $han 
others? Only one investigator specifically tested for a se- 
quencing effect. Power (1976) prepared a series of 23 cloze 
exercises to use with college students enrolledin a develop- 
mentaP reading course. The passages were all taken from 
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college textbooks and sequenced in order of difficulty. Dne 
experimental cloze ^oup received the exercises in asceridihg 
order of difficulty ; the other experimental group received th^rn 
in descehdihg order. Although a significant difference was 
found for order> it was a fluke. Subsequent analysis revealed 
that the difference was due to only brie of the 23 passages. In 
fisserice, theri, order of difficulty made rib differerice. Thiamay, 
however, be a function of the limited range in difficulty 
^ represented in this study. 

~ - In very general sense, researchers havl approached 
sequencing in one of two ways-^very carjafiilly or not at alL 
.Either they systematically sequence instructional activities in 
terms of difBculty or purpose or they develop a blanket set of 
cloze exercises which differ very^Iittle in difficulty or purpose: 

Four stucjies cbuld be used to illustrate systematic 
sequencing. In develppirig materials for primary children,^ 
Guriri arid Elkiris (IdiS) begari with iridividual seritences. Siri- 
gle deletibris were bbvidus arid highly predictable. Next cariie 
lariguage experience stories written by other children of the 
same age. Later, exercises were contrived to demonstrate that 
word meaning could be acquired from context. Finally, other 
passages were used to show the^role of function words. _ _ 
- Kennedy (1972) also used a pTo^ession fromindividual 
sentences to short stories: The first half each training ses- 
sion was spent working through ten individual sentences. 
Short baSal stories were usedduring the second half. The entire 
instructionarsequence culminated with a slightly Ibriger basal 
story. : : __ ^ 

Martinez i-1978) structured her instructional program 
around seven context clues. Each training sessibri followed a 
carefully sequenced progression: 1) A ten minute "directed 
teaching lessbri*' was presented by th^ teacher iri which a par- 
ticular cbritext clue was iritrbduced arid examples preserited. 2) 
Studerits practiced that cliie bn teri individual seriterices (brie 
deletion each): 3) FoUqw--upd^L^cussion focused 9n4:he appropri- 
ateness of responses and signals to clues. 4) Students worked 
cloze passages containing selective deletions related to that 
particular context clue. BlDiscussion centered on the use of the 
clue in longer passages. Each session lasted approximately"45 \ 
. minutes. 
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Rhodes (1972) carefully monitored the readability^ofl^ 
cloze exercises: A large pool of exerdsei waadeveloped with 
severaL at each DaJe-ChaU leveL ^acfi student's progression 
through the levels was, dependent upon successful perfor- 
mance; Presumably, levels of difficulty were adjusted to stu- 
dents' n^eeds: _ ^ 

All four of the studies discussed above, except Rhodes, 
found cloze: to be ah effective instructional technique. Rhodes' 
study differs in two respects from the other three, which might 
account for the lack of significant differences. First, there was 
little or no student discussion or direct teachjng. Second, al- 
. though readability was sequenced, passage length remained 
fairly constant. The similarities among Gunn and Elkins,^ Ken- 
nedy, and Martinez should speak for themselves. Apparel 
cloze instruction which is carefully sequenced^ for example in 
length and difficulty, and adjusted to the reading abilities of 
students^ is- more effective than the undifferentiated use of 
cloze exercises: i : _ : ^ ; 

__ Length of mstruchon. In^he earlier monograph (Jongs- 
ma, 1971)^ many of the early cloze instructidri studies were 
criticized for being too brief. Some in vestiga tors expected to see 
progress after as few as two exposures to cloze training. Have 
studies of a l(>hger duration been conducted arid does lerigth of 
ihstructibh seera to be an importa^ 

The lerigth of iristructiori irt cloze studiei^ has ranged 
from twenty miriutes (Greathouse & Neal, 1976) to seven 
rabriths (PepTri, 1973). The Greathouse & NeaLstudy involved 
ari idiosyncratic Use of cloze (to teach ^e. spellings of selected 
cbritractions) and perhaps should not be considered in this 
analysis. In general, the length of instructional programs 
clustered in' the five to eight week range,: although several 
programs lasted as long as fifteen weeks or more. 

There doesn^t appear to be any clear relationship be- 
tween lengtK^f ihstructibri arid prbgrain effectiveriess. Sbriie 
relatively sh(5rtprograriis wer^e successful while sbmelbrig prb- 
grams were ribt. Two researchers riibriitored the effectiveness 
of their prograriis tlirbugh iriterim testirig. Martinez (1978) 
found that her studerits were giving significantly more syntac- 
tically arid semaritically acceptable responses after only two 
weeks of iristructiori. Johns (1977), on the other hand, observed 



no differencesin performance after eleven weeks of his twenty- 
five week pro^^m. ' , \ ^ . 

Not surprisingly, the (Conclusion seems to Be that the- 
quality. of a^cloze instruction program is:more important than 
its length. The research also does not gi ve any firm evidence as 
to the minimum length needed before cloze instruction is effec- 

tive. - ■ ^ • = ^ • .;: 

Analysis of Deletion Strategieis' ' > ' - ' 

Five sludies have specifically looked at the Varying, ef- 
fects of different deletion systems /Two of those studied fob used 
on the instructional effects .of deleting certain "word types. 
Jxihns(1977) corapared every-ldth, modifier, and noiui-verb de- 
kjions wJiile'iyTo3es-(1972) deleted every-lOth^wor^ atrandom 
and every-iSth nonnTverh: The_oth5er three studies examined, 
modified versions of cloze. Paige (1976) .compared fiye varia-'* 
tions: whole word deletions; first letter of deletions, -iir^t and 
fast letter, >all"co'risonahts, and four word multiple-choice dele- 
tions. Houston (1976) deleted every-l()th word but CQntrasted 
whole Word deleUbhs mth'deletio which retained the^initial 
letter: Kazrrrierski (1973) compared random deletions of whole 
words wj^ two different multiple-chdice f^^^ . „ 

In each of the five studies rhehtioried^abbvej no' signifi- 
cant differences were found among the various types of dele- 
tibh systems regardless of whether progress was assessed on 
standardized reading tests or project-developed "tldze tests or 
multiple-choice tests. Based upon the results of these studieii, it 
appears that the deletion system that is used has little or no dif- 
ferential effect on instruction. Apparently, modified cloze for-, 
raats-sach as the retention ef s^peciSc letter clues do not alter 
the effectiveness of the basic procedure. 

In other studies, investigators have experimented with 
different deletion systems even though the deletion systems, as 
such, were not built into the studies as testable factors. It's im- 
portant to look at these efforts before drawing conclusions in 
this area. __ _ : ^ 

The Pessah (1975) and Martinez (1978) studies are simi- 
lar in that they both used -fcbntext clues to guide the develop- 
ment of their instructional rnaterials. Using SRA Reading for 
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UnSersianding exercises, Pessah made only two deletions pef^ 
' .paragraph; TKe' deletions were equally distributed among 
threfe context clues: 1)_ direct explanation,. 2) indirect explana- 
tion; and 3) inference from general sense of the story. Martinez, - 
bh the other hand, developed a set of exercises based on seven 
context clues. In both of these studies, deletibris were made 
very selectively to give practice in using specific types of con- 
text clues- - ; 

Two studies corid ucted with primary students also i 1 lus- 
' trat^ the Use of selective deletibris. Guriri arid Elkiris (1976) first 
I " triads highly predictable deletioris fromiridiyidual sent^nces''oL 
nursery rhymes and cbmmon expressions, th^n mpved td selec- 
tive deletions within language-experience: s 
deleted -transition words like A' becauBe' ' and **so' ' to stress 
cause-eSect rBlatiqnships, or wordslike/'hefore'Vand'^afterV'to 
shaw time order, or t'if'^ arid' "then'^to point out condition. 
Some.of the exercises they treated were deliberateiy aimed at 
inter-sejitende context clues. Some deletions were as long as / 
phrases or-whble sentences/ Kehnedy (1972) also begari withi 
single 'deletibris in individual senlences. Form class arid ppsi^ 
tion within the sehterice were carefully cpntrbllfed. Later, wheri 
shbrt stbries were used, deletions were agairi lirriited.tb brie per 
sentence wth fprrii class eoritrblled. , / < 
All four of th^e studies, Pessah, Martiriez^ 
. kins, arid Keririedy, U§ed deliberate, setective deletidris to de; 
velbp paHiiiuIai: cbritextual re fbur of these 

Studies were siriiilar iri aribther respect. They each produced 
significarit gains iri studerit cbriipreherisibri or Use of contekt 
clues. Wiiat isets these four studies apart from the five studies 
described earlier in this section is the selective use of deletior|s 
designed to achieve. pariieuiar instructional goals: v 
. in summary^ it appears that selective deletion systems 
aimed at particular contextual relationships are more effective 
instructionally than semi-randorii deletion systems such as 
every-nth word or every mth noun- verb. Of couse, theoretically, 
clbze has been built on the nbtiori of semi-raridbrnness arid this 
nptibri has held up weU, particularly iri readability research. 
Hbwever, for iristructibrial purposes, selectivedeletibri systeriis 
seerii tb be rribre effective. 
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AhalysiH of Scoring: Methodic 

When the cioze procedure is used for testing comprehen- 
sion or assessing readability, the preferred scoring method is to 
count only exact replacements. Howevet", when used for in- 
structional purpoaes, teachers-have been emcoj^raged to accept 
synonyms as well as exact replaceirierits. Does the method of' 
scoring have any effect dh the iristructibhal usefulness of the 
cloze procedure? ^ 
Only brie study could be foiirid that specifically ad- 
\ dressed that question: Iri two replicatidris, Culharie (1972) 
tested the difference between synonym scoring arid the exact 
repiacement method. No significant differences were found be- 
tween the two methods in either study^ although* synonym 
scorings was found to be more effective with lowIC^tudents, as 

mentioned earlier. _ 

The method of scoriiig simply hasn't been treated^^^ 
Experimental variable in cloze instruction research. Nearly all 
investigators have used the ^0xact replacement methpd in scor- 
ing cloze exercises: and the%g^res on the training exercises sel- 
dom are used for data analys^^ 

A few researchers ^ife explored alternative scdnh^ 
methods, even though the methbas were not dir^tly tested. It 
may be worth ribtirig twb of these efforts. Discussibri was an in- 
tegral part bfSariipsbri's (1979) study. Follbwirig the cbriiple- 
tibri of each cloze exercise, srilall grbup discussibri led by thp 
teacher focused on the variety of acceptable answers and the 
reasons why some responses were acceptable and others 
weren't. Sampson-evaiuaied his instructional program with 
tw^ unique scoring methodsr.semantically consistent replace- 
ment scoring and diverg-ent productiom A semantically consis- 
tent replacement was judged to be "..rone or more words which 
replace a deleted item acceptably within the context surround- 
ing: the deletibn...[and]...make sense within the larger context 
of the paragraph and story" (pp.63-64). This system^ of course, 
acceprts replacements which may differ syntactically and se- 
rharitically from the brigirial deletibris, as long as they are 
meaningful. Divergent prbductibri was assessed by tallying 
the riiiriiber bf seriiaritically cbrisisterit^placerrierits, per dele- 
tibri, for each treatrriej^t group. Sariipsbri iT>tt»i^griificaritdif- 
fererices favoririg tl>e clbze iristructiori group ori both of thesse 
measures. y; 



Martinez (1978) applied some of the ideas from Goodman 

und BurkeM Scadirif^ Miscue 1^ to her pre and post 

cloze tests in order to examine the linguistic changes in cloze re- 
sponses that result from cloze instruction. Replacements were 
analyzed for syntactic acceptability (Does the response chariKO 
the syntax of the sehtehce?) and semantic acceptability [Does 
the response change the meaning of the seritehce?). She found 
that studehte receiving cloze ihstructibri improved significant- 
ly in both categories. Interim testing also revealed that syntac- 
tic acceptability improved more quickly thari'Strmaritic accept- 
ability. • 

These two studies suggest that syntactic and/or seman- 
tic scoring systems may be more sensitive to changes that re- 
sult from cloze instrutition than exact replacement scoring or 
conventianal comprehension tests. This would have implica- 
tions for the evaluation of cloze instruction. The literature of- 
fers no clear answers as to which scoring method should be 
used during the actual insiructional process. Common sense 
would suggest that if clo:ze is used for instructional purposes, 
synonyms or semantically acceptable replacements should be 
encouraged, but there is ho research evidence to support this 
belief It should also be recognized that syridriym or semantic 
scoring lacks the bbjectivity and reliability of exact replace- 
ment scoring. Howev^r^ objectivity may be less important in 
teaching than in testing. Requiring students to come up with^ 
exact replacements may be analogous to requiring the "one 
right answer ' to cbmpreherisibn questions.. 

Analysis of Student Attitudes 

OriiB aspect of cloze instruction that has been virtually 
uriexamihed is the whole question of student attitudes^ Do stu- 
dents enjoy working cloze exercises? Da they prefer cloze in- 
struction over ^Jther fbrras of reading instruction? Do they find 
cloze a meaningful and challenging way to improve their read- 
ing? -- - 5 : 

Martinez (1978) is the only investigator who systemati- 
cally gathered data regarding student attitudes. After three 
weeks of cloze instruction, she administered an informal ques- 
tionnaire. In response to _"I like doing cloze exercisesi" 22 per- 
cent responded "a lot"; 65 percent said ''sor^e"; arid 13 percerit 
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chose -*not at all." A second item (VCloze responses are ;..") 
elicited 32 percent for '*furi/' 47 percent **O.K.," and 21 percent 

^ TheaD results cbiild Hardly be depicted as over- 
whelmingly enthusiastic. ^ 
::: :i : ^?:""^J^*^**:*^^^^^^^ have subjectively observed: in 

their studieaih at after the initial novelty wore off, students be- 
came bored doing doze exercises. There are three possible ex- 
planations for such boredom. F'irst, is the lack of variety. The 
typical approach has beenio prxiduce a pool of cloze exercises 
which follow the same format and look the same, even though 
the content of the passages may change: Second, in an effort to 
demonstrate the effectiveness: of cloze instrjjction, many re- 
searchers may have overused the approach, in.somecases, two 
or three cloze exercises were presented daily for se veral weeks: 
^ven ice cream loses its appeal if you eat too much of it Tiixd, 
Unfortunately some of the instruction has been dull, routine, 
and mechanical. For example, in several studies, students en- 
tered seemingly endless cycle of independently working cloze 

^^^^ checking responses without any analysis or 
discussion performance. 

^^her instructional technique, the cloze proce- 
dure can be misused. To be effectivce, it shdtild be used judi- 
ciously and in combination with other methods. 



Summary 

The Gbnclusibris that have grown out of the analysis and 
review of the literature are listed below: 

1. The cloze procedure can be ah effective teaching tech- 
'^^9"^\ ^'^^^^^er, it is -no more nor no less effective than many 
other widely used instructional methods. 

2. 3!he-^cloze procedure is most effective in developing 
reading compreliension, or at least some of the skills involved 
in the comprehensi^on process: It is least effective in improving 
word knowledge or vocabulary: 

3. There is no evidence that cloze instruction is more ef- 
fective for any particular type of material,_auch-as narrative or 
expository. It can be effective with content niaterial: Instruc- 
tion in general cloze materials is more likely to transfer to spe- 
cific content materials than specific training is to general read- 
ing. 
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4. Claze instructidnTs^no more effective for brie age or 
grade level than another. Thoj^e is also no evidence that cloze 
instruction isL better suited to students reading either below, 
above, or.on grade levei, 

5. Altfaaugh-theJiterature is mixed, cloze instruction is 
lifcely to Jbe more effective when discussion is focused on clues 
which signal responses and on the appropriateness of re- 
sponses. ; _ , 

6. There is no evidence that one type of grouping nr- 
rahgement is more effective than another for cloze Instruction: 

7. Cloze rnaterials which are carefully sequenced as to 
difficulty, lerigthi or purpose are more effective than undiffer- 
ehtiated e>;prcises. 

8. The quality of a c|oze instruction program is more im- 
portant ^hari its length. There is no firrii eyiderice as to the 
minimum amount of instructibri that is needed before cloze is 
effective, 

9. Selective deletion systems aimed at particular cbri tex- 
tual relationships are more effective than semi-random dele- 
tion systems: 

_____10._j^ythough the research shows no difference between 
raact repificeip^ntmid sy^ some form of seman- 

tically acceptable scoring should probably be encouraged for 

instructional purposes: 

11. There is no evidence that students have more favor- 
able attitudes toward gloze instruction than they do toward 
other form^ of instruction. 
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Future Directions for 
Research and Instruction 



One of the major bbservatibhs derived from the literature is the 
brbadeiiefd definition of the term **clbze prbcedure." As origi- 
nally cbnceived by Taylbr (1953), the cloze procedure relied bri 
the semi^randbm sampling of whole words. By deleting every- 
nth wbn5, the odds were that the types of words deleted, for ex- 
ample lexical or structural, would balance out over an entire 
passage. In the- past ten to fifteen years of cloze instruction r^h 
searoh, that definition, at teast in. practice, Jias changed con^ 
siderably. The term "cloze procedure" has been used to refer to 
the deletion of individual letters within wojrds, groups of let- 
ters, individual words, phrases, clauses, and entire sentences. 
In addition^ the deletions often have been made systematical- 
ly, hot randomly, in unrelated sentences, rather than caritiriu- 
bus prose. This raises a curious sort of question in this re^ 
viewer's mind. When does a fill-iri-the^blahk task cease to be a 
cloze prbcedure? A typical respbhse tb that questibh might be: 
What difference does it make, br who cares what it's called as 
Ibng as it wbrks? The price we pay for ignbring that questibri 
may be the acceptance of faulty assumptions. Our knowledge 
of cloze measurement^such issues as- validity 
has been established through. the collective eSortsof^^ 
ers_ following uniform procedures. When researchers ekperir 
ment woth modified formats, they usually assume that their 
new formats possess the same psychometric properties as tra- 
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ditibrial cloze. We ihbuld be cautious in transferring bur kribwl- 
edgB about traditional clbze formats to rhbdified formats until 
sufficient evidence supports such a transfer. 

There are a number of unanswered questions regarding 
cloze instruction which could b^a^addressed by future research. 
How can cloze best be Used to isupplement conventional meth- 
ddj3 of reading instruction? What form ishould discussion take 
in teaching the cloze process? How do task demands influeiice 
studentperformance^What method of scoring and feedback is 
most effiactive fbr-instnictiqn? How-raay- cloze best be used to 
promote the reading mijearning^^ 

effects of cloze instruction transfer from one style of writing to 
another or from one content area to ainother? How can the diffi- 
culty and purpose of close ihstructibri be altered through the 
use bf mbdified formats? As the abbve questibnsirriplyi futur^ 
research heeds tb examine particular features bf clbze iristrucr 
ti bhi hbt simply compare clbze teaching with coriventibhal 
methods of ihatructioh. 

Two major areas for future research and instructibri will 
bje explored in iSame depth. FiriSt, the iiSiSUeof iSelective deletions 
will jt)e diiscussed. How shoulcji they be made and for what pur- 
pose? Second, alternative methods of sequencing cloze instruc- 
tion will be proposed. 
/ 

- '-/_ - • _ - - _ - 

Random versus Selective Deletions 

The literature appears to indicate that cloze instruction 
is more effective at imprbyirig reading cbmpreherisibri than 
other aspects bf reading prbficiehcy. Furthermore, selective de- 
letibha which are focused on particular contextual relation^ 
ships have a greater ihstructibrial effect than random dele- 
tions. Perhaps aii analogy would be useful in explaining this 
difference. Suppose brie wanted tb imprbve his/her tennis 
game. One way bf dbirig sb wbuld be to simply gb out and play 
lots of sets of tennis under game-like condi titans. A second _ap- 
P?^^^^^?^:'^? to-prS^Kejon^electedaspects 
l£e serve^ backharLd,_or the volley _in^ contrived Jion-game-like 
sitioations. Wo rSing random deletroii cloze exercises is some- 
wSat like plajdng sets of tennis. Some shots are easy; others 
are difficult. It's;also difficult to predict,^ before a jset begins, 
what aspects of your game will be tested the most. Working se- 



lective deletion exercises, on the other hand, is like practicing 
aelective^spects of your game. Eventually, of course, those se- 
iectiva aspects jnust he combined into a unified whole. 

If cloze exercises which jutilize selective deletions are ef- 
fective, what process should researchers and practitioners fol- 
low in making deletions? What conceptual frameworks^^are 
available for guidance in this area? Three possible frameworks 
will be suggested. 

One approach is to use context: j:lue classification 
schemes, such as those of Artley(1943) and McCullough (1945), 
as a framework for making deletions. As r^^ earlier, 
Pessah (1975) arid Martiriez (1978) both developed cloze train- 
ing materials based updri particular cbritext clue categories 
and found such iristructibn valuable. Lee (1978) has offered 
some practical suggestions for usirig this approach, particular- 
ly as applied to materials in the cdriterit areas. Orie drawback 
tolhis-approach is that the context clue categories dfteri over- 
lap and ara not discrete. However^ if the categories are choseri 
carefully and the training materials are unambiguous, this 

method can be effective: > ' 

11 : A second approach might be to use the framework of 
-Halliday and Hasan (1976). Hallrday and Hasan have devel- 
oped an elaborate systemJbr analyzing and describing the se- 
mantic relations of text. Theft framework consists of five dif- 
ferent types of cohesive ties: reference, substitution, ellipsis, 
cohjurictiori, and lexical cohesion, Reference pertains to items 
which make reference to sbrhthirig else for their interpretation. 
The three types of refereric^are p^sorial, derilbristrative, arid 
comparative. Substitution refers to thereplaceiru^ritdf brie item 
by another. Thethree types of s^bstitjjtion are noininal, verbal, 
and clausal^ElUpsis,_t&aomissiiSm of an item, iasimilar to sub- 
stitution and is sfmetimeSTeferreHtois^uhstit^ 
that is, somethiniis leftjunsaid. Conjunction serves as a^cohe^ " 
sive dievice by linlnng together what is to follow with what has. 
gone before. Four types of conjunctive relations are additive, 
adversative, causal, and temporal. Lexical cohesion involves 
the use of vocabulary that is in some way related to pre viously * 
bccurririg items. The twb basic types of lexical cohesion are re- 
iteratibri arid cbllbcatibri. 
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II : :U would seem that researchers might be able to use the 
Halliday arid Hasan system as a framework for making selec- 
tive deletidris in cloze trairiihg materials. Fo bldze 
exercises could be develdped which focused on particular cohe- 
sive ties, such as causal cdrijurictive relatidris. PresUrriably, 
such irislructidri would increase students* ability to recognize 
and comprehend particular semantic rekrtionships and ulti- 
mately result in improved comprehension. This^ppxoach 
• could be readily adapted to expository texts in_conteat areas: 
A third approach has been suggested by -Cambourne 
(l977)^He conducted anexploraitory-pilotstudy togain psycho- 
linguistic insighte into the silent reading process by applying 
ReaxJjMg-^scue inventory procedures to the cloze procedure. 
Building upon Goodman's notion of three cueing systems (syn- 
tactic, semantic, and graphophonic), Cariiboume hypoihe- 
sized that deletions could be made to assess a reader's use of the 
cueing: systeriis. For example, he theorized that deleting words 
which have a very high syntactic role to play, such as cbnjuric- 
tibris, prepdsitioriSi arid inflectibris^ would give insights into a 
reader's use of the syritactic cueing system. Use of the semantic 
cueing system could be inferred from deletidris df high irifdrma- 
tidri bearirig content wdrds, such as nouns, verbs, adjectives, 
and adverbs. Insight into the graphophonic cueing system 
could be gained by deleting selected letters. Cambourne then 
developed cloze tests containing deletion Patterns described 
above andadrainistered them to elementary students stratified 

; by reading ability. _ _ - - - mz z - -llz. i 

Differences w^re noted between gooiand poor readers, 

which led CambiJume to infer five specific reading abilities or 

' processes that are needed to do well on cloze tasks. Those five 
are: 



1. Ability to refer back iritd the text td find a clue to 
ixteariirig. - ^ 

2. Ability td refer ahead in the text td find a clue to mean- 
ing. • : : 

3. Ability to use real world knowledge-^the network of 
meanings and relationships already known about the 
topic or story being read. 

i 
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4. Ability to use cumulative and logical build-up of story- 
line, i.e. monitoring the story /topic line to enable logi- 
cal predictions. 

5. Ability to use letter clues. 

After identifying these five uhderlyihg abilities, Cam- 
boujrne conducted a fdlldw-iip study. He created cloze_tests by 
systernatically making deletions aimed at each of the five cate- 
gories -Another jgrpup of elementary students, stratified by 
reading ability^ was tested. The results were analyzed by read- 
ing levels in an effortia^istinguish between the processing 
strate'gies'vsed By good and poor readers. 

In general, Gambourne's findings parallel those of mis- 
cue analysis research. Above fiverage readers make better use 
of the syntactic and semantic cueing systems^More specifical- 
ly , above average readers use backward and forwarisearching 
behaviors much more effectively than below average readers; 
above average readers bring to bear a wider range of accumu- 
lated meanings arid experierices; arid above average^ readers 
maintain and moriitdr the story lirie more efficiently. Interest- 
i^yvL^^^e were no major differerices between above average 
readers' use of the graphbphdriic cueing 
syjsteni. It w-as also observed that average arid beldw average 
readers produced, a significant number df partial cdristrue- 
tions. That ia^ many timea their cloze respdnses were accept- 
able ojnly with the first portion jof the sentence and ridt with 
what followed the deletion Abo vaaverage readers, in contrast, 
riiade relatively: few_pari;ial constructions. Theijtreplacements 

tended to be either fully: syntactic or totally wrong: 

j Cariibourrie's study is not^ of course, a cloze teaching 
Mudy. However, it may hav^ implications for eloze instruction. 
If the five proposed categories are indeed valid and if good and 
poor readers differ iri their ability to usethe five processes, then 
conceivably CambdUrrie's system could be used as a frame- 
work for JSiaking selective deletidris. Cldze iristructibn which 
^^^L^A^^:^PP^^^<^h be directed at develdpirig onedK 

more ofihe^five basic processes. It should alsd bepdirited dui 
that eambourne's categi^ries- are closely related to Halliday 
and Hasan's work. For example, backward prdcessirig may be 
thought as anaphora, forward processing as cataphdra, arid 
use of real world knowledge as exophora. Although we have ev- 
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^uch as anaphora (Ghapnaan, 1979; Kingston, 1977; and Ri- 
chek, 1976-77), the instructional uses of cloze in this area have 
gone unexamined. 

In surhrhary, three conceptual frarheworks have been 
suggest^ to guide researchers in designing cloze ihstructibri 
rnaterials which contain selective deletions: 1) context clue 
classification schern^; 2) Halliday arid Hasah/s cohesive tifts; 
and 3) Cariibourrie's processing strategies. Cloze iristructibri 
which follows brie br riibre bf these framewbrks will hav^ a 
much sharper and rnore specific focus. The cloze exercises 
themselves will have fewer, more carefully selected deletions. 



Sequericirig Iristructibri 

0ne of the conclusions derived from the literatu^ 
is that cloze materials which are carefully sequenced as tb diffi- 
culty, length, or purpose are more effective than uriSifferehtt- 
ated exercises. If such is the case, what guidance is a vm 
researchers arid practitioners whb wish tb sequerice clbze iri- 
structibri? Three approaches tb sequericirig will be discussed. 

Sariiuels arid his colleagues (1974) cbriterid that clbze 
teachirig studies haven't beeri sU_Gcessful because they "... did 
riot prbvide trairiirig bri the subsRills necessary for successful 
clbze performance and the failure to find diffCTences-may have 
been due to the students* inability to performed profit from 
cloze-type exercisea" (p: 836). In an effort to design more speci- 
fic instruction, Samuels undertook a task analysis of a partial 
niodei.of word identification. The outcome was the identifica- 
tion of seven suhskills which were believed to underlie cloze 
performance. The seven subskills are listed below: 

i> Ability to say a word given ah^ initial sourid. 
Example: Tell me a word starting with/p/. 

2. Ability to deteririirie the begiririirig letter bf a spbkeri 
word. \ ^ 
Exairiple: What is the first letter iri **giri"? 

3. Ability tb recbgriize visually the initial letter of a word 
presented orally. : 



Example: What's the first ieiteF iS "Boy"? 

Student chooses from among letters pre^ 
sented visually, e.g., b, c, t r 

4. AbiJity to ttse auditory context to predict words that 
could logically follow. 

pample: Finish this Bentence. "My mothe^ sleeps on 
_ her " (presented orally) 

5. Ability to use auditory context to predict word(s) that 
could logically follow itt a sentence hearing just the 
initial sbUrid of; the word^ ' 

Example: Finish this sentence, "the cat ran after the 
e ^c=-r-i '^^'^ ■" Cpresented orally) 

6. Abdity to visual cont^t to predict Wbrds(s) that 
would logically follow in a^s^ntence without seeing the 
mittalJetter of the word. > 
Example^nish this sentence. "The children open 

7 itK i i i " (presented visually) 

^ Ability to use viaual context to predict word(s) that 

could^bgically follow in a sentence when given the 

inibal letter of tiic-target Word. 

Example:Finish this sentence. "The/^fl ate the 
^ — — — " (presented visually) 

f== u training .materials wer^ developed to 

teadi the^sjven subskills. Twa studies Were cdnduclU^tne^ 

third^ade readers. It was found that trainiri| in the seven 
subsMsjmproved the accuracy and^peed of w^^rd recognition 
js well as performarice on cloze tasks. Sartiuels' subskill 
fnf^'T/"''^^ ^"^^"^ to researchers mk practitioners 
iSdenfe cloze instruction fo| primary level 

K^r, ^^''^^^PP^'^^ my^mn^ cloze Instruction has ' 
^^u^^^^^^'^^ «^^«cifcsystem takes 

and tS n ffl ^^?" the^type of deletions, the Bte of deletions, 
and the difficulty of the reading material. Tlhis visual doze 
trjining prograni consisted of six methods of /resenting cloze 
Ihe directions for each method are listed belbw: 

Method i.. Delete every^lOth word at random. Provide 
the first letter of each deletion. 

i * 

^_ ^ i \ ■ 

,^ Cloze Ijisirnction Research 



ERIC 



Me^iod 2. Delete every-lDth structure word (houh deter- 
mineriB, prepdsitibris, prohduhs, auxiliary 

: : : : i verb, arid coiy urictidris). ^ 

Method 3. Delete every^Ui fltructure word. 

Method 4. JDelete every-Wth cphterit word (hoilri, adjec- 
tive, base verb, arid adverb). 

Method 5. Delete every^th content word. 

Method 6. Delete every-5th word at random. 

: : : Iri additidii, Aulls prbpdses that asequerice be fo lib wed 
within each riieth<)d. The first clbze exercise should be based on 
a lariguage experierice stbi^ gerierated by the student. The next 
two clbze exercises should be based on material at the student's 
ihrfepehcf^h? readirig level. The next three exercises should be 
bas^ on materials at the student's m«trwctf(ma/ reading level. 
Thus a sequence of six cloze exercises would be jused^for-each 
method aiid thirty-six exercise& fcM^ the -total program. 
I^esumably, the number of exercises jCQuld be varied depend- 
ing upon student-performance and needs. Aulls also offers 
suggi^stionB for discussing^ modeling, and questibriirig which 
could be-used throughout the training prbgram. Althbugh this 
is a^ logically developed sequence,' there is rib empirical, 
evidence that this approach is effective. 

__fiankin (1977) has also proposed a series of sequerice 

strategies for teaching reading cbrripreherisibri with the clbze 
procedure. These strategies offer researchers arid practitibriers 
a: sprigs bf bptibris that cbuld be used to modify arid adapt the 
clbze prbcedure for iristnictibri. The; strategies are outlined 
below: 

I. Iritroducirig the Clbze Prbcedure 

A. Use aural clbze. 

B. Use aural-visual cloze. 

C. (Use viaual cloze.\ ^ - : ^ 

II. Selecting Reading Passages ^ --^ 

A. Begin with language experience materials then 
proceed to materials- from J3ther sources. 

B. Beg^n J»dth easy m^^ and proceed gradually to 
nxore difficult readability levels. 

C: Bfigin with high-interest, riarrative riiaterials; 
proceed to less iriterestirig, expbsitbiy materials. 
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HI. Ghoaaiixg Scoring Procedures 

A. Use B3monym scoring. 

B iUee exact word scoring. 
IV. Selectihg Word Deletions « 

A. Rate of deletions. : : : 

1. Begin with a low deletion ratio (e.g. 1 deletion per 
10 words) and gradually proceed toward higher 
deletion ratios (e.^. 1 deleti^)h per 5 words) Using 
cloze scores to determine pace. 

B. Tyf^ of deletions, ' 

1. Use lexical deletions with prompts. ■ - ' 

2. Use structural deletions witii jjron^^ts: 
, 3. Use any word deletions wi&i prompts:. 

4: Use structural deietixmB withoat prompts: 
5: Use aay word deletions without prompts: 
6: Use lexical deletions without prompts. 
V. Determining Response Types 

A. Fbrinat : : : : : : 

1. Use ihultipleKihbice alternatives. 

2, Use :"fill-in-the-blahk.'-^ 

B. Multiple^chdice options : 

1. Use alten^atives of different semantical mean- 
ing ah^frpm cfz^reni gram 

the coinrect choice. ^ 

2. Use alternative of rfx//erent semantical rfieaning 
and from the same grstmmatical class as the 
correct choice^ . y 

VI. Using Visual Clues 
A: Pictures 
B: Letters^ ---- -- 

G: Underline marks ^ 
D. Length of blank space 
VII. Using Reirifbrcemerite^ ^ 

A. Use weak reinforcements for easyj materials^ use 
: strong reinforcements for more difficult materials. 

B. Use strong reinforcements for "uninteresting" 
materials; use weaker reinforcements as the task 
becomes self-reinforcing. : 

C. Use continUoUis reinforcement; use intermittent 
reinforcement 
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Rinkin cautions that these atrateffies should be viewed 
as hypotheses ujiUi empirical studies have confirmed their 
applicability and effectivess. m z i: z 

In sumrhaiy, three approaches to sequencing cloze 
instnictibn haye been, presented: 1) Sarnuels' task analysis 
subakills, 2) Aulls' visual cloze training system, and 3), 
Rankin's sequence strategics. Although they are different, 
common threads run through all threeapproaches. Onlyone of 
the thre^, Samuels', has been ernpirically tested and only ^on a 
limited basis. More research^iaclearJy needed to verify optimal 
sequences for presenting cloze instruction^ ; _ 

It is hoped that ihe results of future research , cbrhbihed 
vnth our current Btete of knowledge, will lead us to more 
jtidicious and effective use of the cloze procedure as a teaching 
techniqiJe. 
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approaches;, all ap- 
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No significant dif' 
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BaynedW 



Pepin (1973) 
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ferences among cloze 



regular hign- 
interest low-vocabu- 
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(i973j MteeBtudenta To; increase know- Fourteen ' Knowledge of NdsignifiMntdif 

enrolled in :. ieilge of business: weeks teness'test; ferenceainong cloze 

IntraducfioiiB coiicepfe arid read- : MmUenny andjraditional 

Business W7) ing skills '■ instructional: v!" - 



Power(1976) Disadvantaged To increase: read- : Five weeks' Ikwo'stii' Ndsipificantdit 
college students ing cornprehension EMm^ Test Terence fttween cloze 

l'^'^^) and lecturediscuB- 



sion, 



lers . To increase teal, ' Six weeks ; :'Sl#rfl!:... Nosipficaritdif- 

(n:153)' inferential, and S'poslic , ferenc* lietween 

total reading com- ft^in^ hi ' eloze and regular 

1 prehension comprehension in- 



struction 
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(n=189) ing comjfreliensibri Gin;]i> " 



Ming Test cie:and_reg.ular 
comprehension in- 
struction 



Sampson (1979) Third, graders To increase vocabu- Fifteen 'Gaifs- Significant i 

(n=92) lary, comprehension, weeks MacGmtie encei 

Pi^O" ^J^M over:reading.center8'' 

Meet-.. : on comprehension; 

. developed no difference oil 

cloze test; vocabulary 
Divergent- 
production 

test ■ ■■ ^ 
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"Researcher ' Silmple Infi tnictional Goal Troatiricn t- Moaiur^ Finding 5 



Sinatra p7) High-riflli Tbiricreasetead- Foiifwe^fi Pfojcct- : ' Significant gaitis on 
second-Bixth ing comprehension developed cloze tcfit for all 



; So& :_ SDRT for second only 

kaimM 



Smith (1970) Jmiorcoiiege- . To increase read- Not stated Ndiiekiveii Siibiective evalua- 
stdenta : ing comprehension , • tion supportfl use 

' (ii not given) - ^cloze 



Stewart (ii?) Freshman ■ To increase vocahu- Eij(ht weeks Not stated No significant dif- 
cgS.. lary.c§prehehsi{)n, • ^^^^"ce^^t*'^'^- 

students and totaj reading 

(n=91) flchievMent. 



Whitmer(1975) College students To increase read- One:. MM : 
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Note: In some cases, the reviewer relied oil ptibji»hed reports, including Diumion Ahsimls Intemtioml, rather than on 
unpublished original dissertatioiis. , ■ ■/ , 
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